A Markov model is a stochastic process where the probability of each step in the sequence is dependent only on the previous step, or in the case of higher-order Markov models the last n-steps. Markov models are frequently shown as matrices where each entry in the matrix Mik represents the conditional probability that if the current state is i, then the next state will be k.
Used on page 318